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Abstract. We discuss the feasibility of quantum Hall states of vortices in 
trapped low-density two-dimensional Bose gases with large particle interactions. 
For interaction strengths larger than a critical dimensionless 2D coupling constant 
~ 0.6, upon increasing the rotation frequency, the system is shown to spatially 
separate into vortex lattice and melted vortex lattice (vortex liquid) phases. At a 
first critical frequency, the lattice melts completely, and strongly correlated vortex 
and particle quantum Hall liquids coexist in inner respectively outer regions of 
the gas cloud. Finally, at a second critical frequency, the vortex liquid disappears 
and the strongly correlated particle quantum Hall state fills the whole sample. 
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1. Introduction 

There has been enormous interest in the last few years in the properties of trapped 
Bose gases set under rotation, both theoretically and experimentally (a small selection 
of recent contributions is^l^lEl^lSliniE]). Of particular interest is the behavior 
of (effectively) two-dimensional gases in highly correlated fractional quantum Hall 
states (FQHE) 8 . These states lend themselves for an exploration of physics beyond 
the mean-field picture, where the role of the strong magnetic field in the FQHE of 
ultrapure 2D electron gases is taken over by a fast rotation of the gas. 

The formation of FQHE states in a rapidly rotating, harmonically trapped dilute 
Bose gas, such that the Landau level mixing due to interactions can be neglected, 
was studied in Ref. It was found that, after the vortex lattice melts, at a critical 
filling factor of the rotational Landau levels the system of particles enters a highly 
correlated quantum ground state. The many-body wave function corresponding to 
this state was numerically shown to have large overlap with a bosonic version of the 
many-body quantum Hall ground state introduced by Laughlin for electrons 8 . 

Instead of a quantum Hall fluid of particles, one can equally well consider the 
vortices in the fluid to be the elementary objects, forming themselves a highly 
correlated quantum fluid. Previously, a quantum Hall fluid of vortices has been invoked 
to explain certain features of Hall conductance and magnetization experiments in high- 
Tc superconductors In the present paper, we propose to investigate 

vortex liquid phases in a rotating, spatially inhomogeneous, harmonically trapped 
dilute Bose gas. It is shown, in particular, that there exists a critical dimensionless 
2D interaction strength, g = gc ~ 0.6, above which several phases can coexist (we set 
h = m ~ 1) 14 . In the limit of weak interaction, for g < gc, and after the vortex 
lattice has melted, the particles are confined to the lowest rotational Landau level and, 
for low enough temperatures, the system makes a transition into the particle Laughlin 
state. For g > g^ on the other hand, a transition into a vortex quantum Hall state 
can occur. Upon partial lattice melting, the system separates into a low-density phase 
in which the vortex lattice has melted, and an inner high-density region, in which a 
vortex lattice resides. At a critical rotation velocity, the lattice melts completely, and 
the inner region consists of a vortex quantum liquid, while the outer shell enters a 
highly correlated particle quantum Hall state. Finally, at a second critical velocity, 
the vortex liquid phase disappears and the particle quantum Hall state fills the whole 
sample. 

Below, we first introduce the basic vortex Haniiltonian of superfiuid 
hydrodynamics in the rotating frame, upon which our discussion of the various vortex 
states will be built. We then give in section III the criterion for the melting of the 
vortex lattice into a vortex quantum liquid for a general rotating, uncharged superfiuid. 
In section IV, this criterion is specialized to harmonically trapped Bose gases, where 
it is demonstrated how the phase separation described above is obtained from the 
inhomogeneous density profile of the gas cloud. In section V, we describe possible 
experimental means to verify the existence of the vortex quantum liquid. Finally, the 
conclusions section contains a discussion of how the zero temperature limitation, used 
in the following sections, can be lifted at practically all temperatures for which the 
vortex quantum liquid can be observed. 
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2. Vortex Hamiltonian and Plasma Analogy 

Consider a two-dimensional (2D) Bose gas at temperatures well below the Kosterlitz- 
Thouless transition temperature T^"^ = Trp/2, where p is the 2D particle density. 
In this superfluid state, phase fluctuations are provided by phonons and bound 
vortex-antivortex pairs. Vorticity is a good quantum number, and the vortices 
are "fundamental" objects. At sufficiently low temperatures, we can neglect the 
dissipation which arises from scattering of thermal excitations on vortices, so that 
their dynamics is conservative. The situation considered then corresponds to the 
Magnus force dominated limit of vortex motion in very clean superconductors |H1 E| ■ 
The vortex motion is governed by a Hamiltonian corresponding to one of point 
particles, with a charge equal to the quantum of circulation k = 27r, interacting with 
electromagnetic fields. For a large collection of A^^ ^ 1 vortices (cf. Fig.^, in a frame 
rotating with angular velocity il, the vortex Hamiltonian reads [Ifil I17j : 



We emphasize that the hydrodynamic vortex Hamiltonian above does in its validity 
not depend on the (microscopic) form of the many-body wave function; it describes 
the system accurately if the matter we deal with is a superfluid. The Hamiltonian 
is also valid if the density varies like in the (harmonically) trapped case of currently 
experimentally realized Bose-Einstein condensates, as long as this variation takes place 
on scales much larger than the intervortex distance. This is the case here, because we 
will consider below large vortex densities, with intervortex separations of order a few 
times the coherence length. 





,2 



N, 



(1) 




Figure 1. A large collection of quantized vortices, each with mass and 
circulation k = 2it, in a rotating gas of radial size R and density p = p{r). The 
vortices i are moving in the rotating frame at velocities \Xi \ <^ Cs, at a distance 
|^,;| from the center of rotation. This system is described by the Hamiltonian 
0. 
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The first term in Q is the kinetic energy of vortices, the second stems from a 
— n • L coupUng, the Coriohs force on vortices, and the last term is the repulsive 
logarithmic Coulomb interaction of point vortices. In the symmetric gauge, the vector 
potential Ai, responsible for the vortex velocity part of the Magnus force on the vortex 
(the analog of the Lorentz force), takes the form Af = ipe^^X^ (a, b = x,y) JT]. This 
vector potential corresponds to motion of a charged particle in a "magnetic field" 
perpendicular to the plane, of magnitude p. The canonical vortex momentum of the 
vortex i is consequently given by the sum of the kinetic and field momenta, 

P, = m„ (X, + O X X,) + kA, . (2) 

The vortex mass is due to the density disturbance a moving vortex causes in the 
system. For a single central vortex, it is given by = [pK^/(47rc^)] ln[_R/ac] = 
[k^ /4:TTg]\n[R/ac] ^1], where the core size ac = O(fo) is of order the bulk coherence 
length ^0 = l/V^f/p, and Cs = y/gp the speed of sound JHI- The interaction strength 
parameter g is related to the compressibility x of the fluid by x = ^/ 9P^ — ^/pc^- We 
will take below the limit of ruy ^ 0, so that the precise value of my, in particular its 
modification in the presence of a dense vortex lattice, is not of importance to us, but 
only that to„ has a finite value. The latter fact is important for the quantization of 
the vortex position and momentum degrees of freedom in a straightforward canonical 
manner, because for niy — exactly, vortex phase and configuration space coincide 
|5Q^, that is, vortex momenta become (gauge dependent) functions of the vortex 
coordinates alone. 

The ground state of the Hamiltonian can be analyzed by setting all the vortex 
velocities to zero (in the rotating reference frame) and finding the vortex configuration 
by minimizing the energy: 

Af„ 2 

H:^lpnnj:xf-^j:'n 

1=1 l<j 

We neglected the centrifugal potential — ^rriyil'^ J2i!^i -^f the above expression, 
which is justified by taking the small mass limit rUy ^ in In a plasma analogy, 
the first term in the Hamiltonian provides the neutralizing background to the 
potential created by the vortices. In the rotating frame the system is identical to a 
system of charges interacting by 2D Coulomb repulsion in a neutralizing background 
(the total circulation being zero as seen in the rotating frame), such that the 
ground state of the system is given by the spatially homogeneous vortex density 

3. Vortex Lattice Melting 

The uniform vortex density solution is only a first approximation for the ground state 
properties of the rotating superfiuid. Since the vortices repel each other, the energy of 
the liquid can be lowered further by forming highly correlated states. At relatively low 
vortex density, the vortices form a triangular lattice ,24- The excitations above this 
vortex lattice ground state in a rotating dilute Bose-Einstein condensate have been 
the subject of recent experimental and theoretical studies They represent 

Tkachenko waves f2BI, modified by the interaction of the vortex lattice vibrations 
with sound [22] • 

According to the electrodynamical analogy, the Abrikosov-Tkachenko vortex 
lattice may equivalently be understood as the (bosonic) Wigner crystal of vortices, 



Xi — -X", 



(3) 
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analogous to the (fermionic) Wigner crystals formed by electrons [JS] I26L I77| . On the 
other hand, for large vortex densities riy, the lattice melts, at zero temperature due 
to quantum fluctuations, and the vortices form a highly correlated quantum liquid. 
Indeed, long-range logarithmic interactions, experienced by our (bosonic) vortices, 
have already been shown by Laughlin in his seminal paper on the (fermionic) FQHE 
to yield excellent overlap with incompressible quantum Hall states (cf. 0, Table I; 
see Ref. [2H1 for the present bosonic case). 

In the limit of small vortex mass rUv 0, we have large quantum fluctuations of 
the vortices around their equilibrium lattice sites, as well as confinement of the vortices 
to the lowest Landau level of the Hamiltonian The dimensionless parameter 

where the interparticle distance and £y = ^ tt/D, the mean distance 

between vortices, then controls the relative strength of quantum fluctuations and 
therefore the (zero temperature) melting transition into the quantum Hall state. The 
above parameter is the vortex filling fraction corresponding to the ratio of the number 
of vortices, associated with — Q/n, and the number of "flux quanta" associated 
with the "magnetic" field of strength p, which is just the number of particles itself. The 
filling factor Vy of the vortex rotational Landau levels is just the inverse of the filling 
of particle rotational Landau levels, v = l/vy. The Laughlin wave function for the 
vortices reads, in the usual complex notation for the vortex coordinates Zi = Xi + iYi, 



np 
Y 



(5) 



i>j 

where 1/vy is even. 

The Hamiltonian has been studied in the context of vortex matter phase 
transitions in layered high- Tc superconductors El i where the possibility of 

a melting transition for the vortex lattice is due to the low Cooper-pair superfluid 
density p in these materials [5] . In the simplest approach to melting of matter ordered 
in crystals, one assumes a Lindemann criterion [^Hl, which simply states that the 
departure of the vortices from their lattice positions should approximately equal 
their separation iy. In more refined treatments one takes the vortex lattice 

and Laughlin state wave functions for the vortices, and evaluates their corresponding 
energies, equating them at the transition point. In the limit of small vortex mass, the 
zero temperature transition point from the vortex lattice to the Laughlin state is, using 
either method, Lindemann or "exact" evaluation of correlation energies, consistently 
within a factor of order unity found to be at [U ^2 

Vy — {i'y)m ~ 0.1 (melting filling factor). (6) 

At absolute zero, for i^y < {vy)m, the system is in the vortex lattice phase, and for 
Uy > {i'y)m, it is a vortex quantum liquid, i.e., a "melted" vortex crystal. For small 
interactions g 1, the resulting state was shown to high accuracy to be a quantum 
Hall state of particles El ■ In the next section, we argue that for sufficiently large 
interactions g, the resulting quantum Hall liquid is, conversely, one of vortices as the 
elementary constituents of the liquid. 
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4. Vortex Liquid States in Harmonic Traps 
4-1- Coexistence of Solid and Liquid Phases 

An isotropic, harmonically trapped 2D gas possesses, in the Thomas-Fermi limit, an 
inhomogeneous density profile of the form 



i?2 / 



Here, 



are the central density and the squared Thomas-Fermi radius of the condensate 
cloud, respectively. In contrast to an essentially homogeneous system like a 2D 
superconductor, the melting condition © then becomes a local criterion due to its 
dependence on the local density. While the density is a locally dependent quantity, 
it is important to recognize for the ensuing analysis that the observed vortex arrays 
possess a striking regularity ^E]. Even though the particle density is inhomogeneous, 
the vortex density is to a very good approximation the constant Uy = Q./tt |3U[I31[I5^ . 

To reach the vortex quantum Hall state in the melted phase, in preference to 
a particle quantum Hall state, the following two conditions have to be fulfilled. 
Firstly, for the lowest particle Landau level description to break down, large particle 
interactions have to mix the first two rotational particle Landau levels such that 
L0±_ + Q. ~ 20. < gp. Second, for melting to occur the rotation rate has to be larger 
than 7rp(i/„),„. These two conditions give 

7rp(i^„)m < < gp/2. (9) 

We conclude that, for a finite Sl-region to exist in which the vortex quantum Hall 
state is preferable over other states, g > gc needs to be fulfilled, where 

g, = 2n{v,)^ « 0.6. (10) 

In addition, our small mass assumption can only be justified if the Coriolis force on 
vortices is (much) smaller than the vortex velocity part of the Magnus force, i.e. when 
2m„f2 pK. This leads to <C gp/ \n[R/ a,^ which is for large systems more stringent 
than the Landau level mixing criterion Vi < gp/2 by a logarithmic factor ln[i?/ac]/2. 
However, for the purpose of the present discussion, in the mesoscopic trapped gases, 
the difference between the two criteria can be neglected. 

We distinguish the following cases, cf. Fig.|21 At sufficiently low angular velocity, 
fl < ilci, with 

An,, = co^-n,.,,^ /[^^ (11) 

the system separates into three distinct phases, cf. Fig.[21 (a) (it is understood that all 
expressions for Afi are valid in the large N limit, i.e., for Ail./uj± ^ 1). The center of 
the trap is occupied by the vortex lattice (region I) , surrounded by two vortex liquid 
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(a) 



(b) 



Figure 2. Different vortex pliases in a harmonically trapped gas for various 
regions of rotation velocity, (a) The region I signifies the vortex lattice region; 
the region II the melted lattice (vortex liquid), and in the very-low-density outer 
region Ilia the particles are in their lowest rotational Landau level, (b) For 
increasing Q, the inner "solid" vortex lattice phase disappears completely at f2ci 
given by Eq. 1111 . and particle and vortex Laughlin state coexist in outer (lllb) 
respectively inner (II) regions of the gas. Finally, at n > f2c2i given by Eq. I17i . 
the vortex quantum Hall state disappears, and the particle quantum Hall state 
prevails throughout the sample. 



phases, in which the vortex lattice has melted. Phase II represents the vortex liquid, 
and is defined by Eq. . The inner and outer radii of the shell are given by 



1 



2n 



i?2 



i?2 



1 



1 2fi 



and the area of the shell AA, relative to ttR^ 
AA 2VL 



The number of vortices in the shell is 

4172 



- 9?) 



1^2' 

, therefore is 

9_ 

9c 



- 1 



V Jshcll 



f]2 



(12) 



(13) 



(14) 



(15) 



For the width of the vortex liquid shell to be a significant fraction of R in the limit 
oo, such that {Ny)shc\\ oc N, AO has to be a significant fraction of Afici. 
Furthermore, the density must be approximately homogeneous for the "magnetic field" 
p to be approximately constant and one well-defined vortex Laughlin state ij^l to exist. 
The two conditions that the region II phases in Fig.|21be sufficiently thin for a constant 
density approximation to apply, and (iYu)shGii on N , therefore require that the coupling 
g is sufficiently close to its critical value gc- The outermost shell Ilia shown in Fig.|2] 
(a) is filled by particles confined to their lowest rotational Landau level. 

The maximum number of vortices in the vortex liquid shell is reached at J7 = fid . 
For given N and g, this maximum number has the value 

max [(7V,)shcu] = ^ (^1 - ^) • (16) 
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If the rotation velocity grows and reaches ^Ici-, the vortex lattice completely melts, see 
Fig.[21 (b). The gas cloud in the region II remains superfluid. Further increase of 
leads to the contraction of region II and eventual disappearance of the vortex liquid 
phase at f2 = ^c2, where 

Ar!c2=c^±-f^c2-^^. (17) 
gN 

For Oci < < f^c2, the number of vortices in the inner melted area II is given by the 
expression 

(.iVujshcll - — -2 1 ====== , 

\uji-n^J y ^gN{uol - 9?) ) 

(18) 

which vanishes at f2 = and coincides with Hl()|) at f2 = fici- 

The strongly correlated fractional quantum Hall states of particles in a harmonic 
trap require that the detuning Ariparticic/f-^i = 1 ^ ^^particio/^± ~ v'^g/N |22|. On the 
other hand, provided the inequality g > gc is fulfilled, the vortex quantum Hall states 
occurs in an outer shell already at rotation frequencies f2 < VLci ^ i^particio smaller 
than the rotation frequencies needed for the particle quantum Hall states. Thus, even 
if only an outer shell of the sample is filled by the vortex quantum Hall state, the 
number of vortices can be still sufficiently large to observe the characteristics of the 
vortex Laughlin state to be discussed in the next subsection. 



^.2. Detection 

We now come to discuss experimental procedures to verify that the state of the vortex 
system is either crystallized or a quantum fluid. We assume in the following that the 
part of the sample under consideration is occupied either by the vortex lattice or the 
vortex Laughlin phase. 

The melting transition can, for example, be detected by letting the gas expand, 
and then investigating the resulting spatial configuration of vortices (cf. Fig.|3Il. The 
primary difference which reveals itself is that vortex liquids present a disordered 
structure compared to the regular crystal. The information on the degree of order 
is encoded in the (assumed isotropic) pair-correlation function g{r). This information 
is obtained from pictures like the ones shown in Fig.|31 by counting the number of 
vortices inside a shell, of radial size the intervortex spacing, at a distance r from a given 
(central) vortex. For a crystalline ordered structure, there are oscillations in the pair- 
correlation function around its asymptotic value, whereas these oscillations vanish for 
the liquid. If the number of vortices is large so that the counting statistics can be made 
accurate enough to extract the small-distance behavior r — > of the pair-correlation 
function, one should find g{r) cx r^/"^" for the vortex Laughlin liquid. An alternative 
method to detect the transition to a melted quantum Hall state was proposed in , 
by directly verifying a relation connecting condensate fraction and density profile. 
One may also conceive of using Fourier-space techniques in situ, and analyze Bragg 
diffraction patterns by scattering light off a collection of vortices. Finally, we mention 
that a very recent experiment has indeed observed, adding a quartic trapping potential 
term to achieve ~ ui±, a transition from a vortex lattice to a disordered structure 
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Figure 3. The vortex quantum Hall state can be identified by measuring vortex 
pair-correlation functions in ballistic expansion pictures. The pair-correlation in 
the Laughlin state jFJ is shown for = 1/2, from 1341 . The two collections 
of points depicted represent a typical configuration in the Laughlin and vortex 
lattice states, respectively. The pair-correlation function of the lattice state shown 
in the inset is an experimentally obtained histogram, taken from |2]. It displays 
a periodic shell structure characteristic of crystallization in solids. 



5. Conclusions 

The preceding analysis was carried out at absolute zero. In fact, the limitation to 
zero temperature can be relaxed. The temperature dependence of the friction force 
on the vortices can be estimated using the result of [37]; the 2D friction coefficient 
T] ^ T'^/c^- Magnus force domination corresponds to p » 77, which leads to T <C pg^^^, 
provided T <^ pg. On the other hand, since quantum Hall states are incompressible, 
excitations of the vortex liquid are separated from the ground state, for finite rUy by a 
gap of order of the Landau level spacing TLandau — up/my ~ pg/ln[R/ac] |2HlEni- In 
the case of large g, the gap is dominated by the interaction between the vortices, and 
Tint ~ pK^ hi[R/ac]- Therefore, if T <C ^Landau respectively T ^ Tint, excitations are 
frozen out and the state of the system in thermal equilibrium essentially coincides 
with the Laughlin state. For the interaction strengths under consideration here, 
the temperatures TLandau Eind Tint are both comparable with the Kosterlitz-Thouless 
temperature T^"^ = Trp/2. The vortex Laughlin state thus forms practically for any 
temperature well below the transition temperature T^"^ to superfluid behavior. 

To realize the vortex quantum Hall liquid, at the low particle densities required, 
moderately strong particle interactions are necessary, g > 0.6, both to accomodate a 
sufRciently large number of vortices into the rotating sample and to drive the system 
into the vortex quantum Hall state. The ultimate limit on the maximal value of the 
particle coupling constant g in a rapidly rotating, inhomogeneous 2D low-density Bose 
gas is not known. However, we may conclude from the study of Bose gases with large 
scattering lengths in Ref. 10' that g ~ 0{1) should be possible before the system 
enters a solid, uncondensed phase. 

Experimental confirmation of the vortex quantum Hall state provides a 
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verification of tlie Hamiltonian (Q, which stems from superfluid hydrodynamics 
123 ^3 1 ^^'^ consequent quantization procedure for vortices as massive, "charged" 
particles. The present investigation should, then, help to shed light on the debate 
about the physical reality of vortex matter quantum phase transitions, whose 
occurence has been extensively discussed for the high- Tc superconductors. It provides 
an analogous phenomenon in a pure, uncomplicated system, for which the force fields 
on the vortices are exactly known. 

Finally, the present investigation raises the interesting question if vortices can also 
exist if only a very small number of particles per vortex, of order 5 • • • 10, is present. 
In an abstract sense, a quantized vortex is a singular hole in the order parameter 
manifold with a certain residue. The hole effectively acts on the particles, making 
them spin around the hole in a manner prescribed by the quantization of circulation 
condition. The question which naturally poses itself, then, is if the vortex vacuum can 
also exist even in the limit of no particles being present. Formulated differently, one 
may ask for the lower limit of particle density, if any, for which the entity quantized 
vortex still remains a well-defined physical object. 
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